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•• Instrumentation for Pattern Recognition and Associated Software 
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: In this paper we describe the biomedical pattern recognition system of . 

the National Biomedical Research Foundation. The hardware portion of the 
^system consists of a high-resolution flying-spot scanner (FIDAC), a vidicon 
scanning system with associated silicon video memory system (VIDIAC), a 
mechanical scanner of very great resolution (DRIDAC), a microscope scanning 
system (SPIDAC), and an interactive communication system (MACDAC). The 
associated software systems used in the operation of the above hardware sys¬ 
tems and in the automatic pattern recognition consist of FIDACSYS, which 
supervises input of the image into the computer from the scanning devices 
and accomplishes overall picture manipulation, and the SYNTAXSYS and BUGSYS 
pattern-recognition languages developed at the Foundation. Finally, a system 
(DOCS) is described which is used for on-line computer-console interaction 
with disk memories for the evaluation and display of large masses of data. 
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• Instrumentation for Pattern Recognition and Associated Software* 

L V’ The pattern recognition system of the National Biomedical Research 
Foundation consists of a number of scanners, display consoles, and inter¬ 
active devices. The laboratory is centered around an IBM 360/44 computer 
(owned by the Foundation), which is used on a "dedicated" basis. The figures 
-show the organization of the specialized pattern-recognition equipment of 
the laboratory (see Figs. 1, 2, and 3). ;v-: L• .-v , . 

v .* All of the equipment (except the IBM 360/44 computer) is of our own 
design and construction; either it was not available from commerical elec- 
tronic manufacturers or its requirements exceeded the specifications of- 
. available apparatus.' All of the scanners and interactive displays are 
integrated into a single configuration through the Pattern Recognition Control 
•System. The SPIDAC (Specimen Input to Digital Automatic Computer) consists of 
an automated microscope with a motorized stage which is under computer control 
in both the x and y directions; it includes an instantaneous automatic-focus 
device. The VIDIAC (Vidicon Input to Automatic Computer) scans the image at 
high resolution and stores it temporarily on the Silicon Video Memory System 
(the heart of which is a new image-converter tube). The stored image can 
• then be read directly into the computer's memory (through the Pattern Rec¬ 
ognition Control System), or displayed on the grey-level TV monitor or the 
MACDAC interactive monitor. The MACDAC (Man Communication with Digital ..... . . 
Automatic.Computer) enables interactive communication with the computer by 
means of a "joy stick" cursor. - The FIDAC (Film Input to Digital Automatic '• ' 
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Computer) is a flying-spot scanner for scanning film transparencies at very 
high resolution; it is also used to make a print or film negative under the 
control of the computer, with high spatial and grey-level resolutions. The 
DRIDAC(Drum Input to Digital Automatic Computer) is a mechanical scanner of 
very great resolution in which a picture or X ray is wrapped around a drum 
and scanned by several photocells moving along a worm gear as the drum 
rotates. • 

- All of the object scanning units (namely the VIDIAC, FIDAC, and DRIDAC) 
have systems that image and digitize the object picture; the digitized infor¬ 
mation can be sent to the core memory of the computer. Also, each of the 
scanned images can be stored on the Silicon Video Memory, in either video 
(analog) or digital form (i.e., a particular grey level or levels); many 
options can be selected by the user. From the Silicon Video Memory, the 
stored image can be displayed with grey levels on the TV monitor. The scan¬ 
ned images can also be stored! on the MACDAC monitor (which is a storage tube). 
Then an interactive-graphics phase of a program can be performed in which the ' 
operator can present to the computer the x and y coordinates of a point, and 
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.'.some*coded information concerning the nature of the point. Finally, the ' 

; computer itself can draw a picture on the MACDAC monitor, or on the TV mon- 
itor via the Silicon Video Memory System {or on a hard-copy printer via the ^ 

Silicon Video Memory System). • Thus the computer can present a MACDAC dis- 

_ f play, a TV monitor grey-level display, a hard-copy grey-level display, and >; J 1|- 

a high-resolution grey-level display on film by means of the FIDAC. ' 

• The specialized, pattern-recognition equipment of the laboratory includes: ^ 

(a) FIDAC (Film Input to Digital Automatic Computer) Mod II. .The FIDAC 
is a high-speed high-resolution flying-spot scanner developed and built at the_.'^j, 
.Foundation. It has a maximum capability of scanning a raster of 2000 x 2000, 

•‘or 4,000,000 sample points within four seconds (i.e., at the rate of one ; 
microsecond per sample spot), with up to 16 grey levels per point. The number 
of sampled spots in the raster is adjustable, as is the number of grey levels. 

For instance, for the analysis of chromosomes by classical (nonbanding) meth-. 
ods, a nominal 700 x 500, or 350,000 sample-spot, raster is most efficacious. 

.The analysis of fluorescent chromosomes is always accomplished from film, for yf : 
the fluorescence fades as it is exposed to ultraviolet light. Thus a photo- 
. micrographic film is made in which the fluorescence from all the chromosomes v - 
>.can be recorded at the same time. (See Fig. 4.) ;V^' ' 

' "'A- ^ ' ; • • ; ' 

The FIDAC has two modes of operation, as follows: (1) A complete picture j-m 
mode. In this mode the raster s size is nominally 700 x 500, that is, the 
picture is sampled at 350,000 spots, and each point can be sampled as black- 
; and-white binary, i.e., one bit per spot, or up to 16 grey levels, i.e., four 
bits per spot. This raster size is used for the examination of biomedical ... 
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photomicrographs which were obtained from an optical microscope, since this 
sampling rate exceeds the resolution of the optical microscope. . (2) Control 

word mode. In this mode of operation a resolution of 2,048 spots across each . 

of 1 ,365 rows (3 x 2 aspect ratio) with a maximum of 16 intensity grey levels , 
can be obtained. This is accomplished by allowing the computer program to 
select all or any portion of the picture to be scanned with a corresponding ' 
sampling density such that the memory space allocated to the picture would • 
not be overrun. ■ / : ^ ■ ■■v’.«- 

The specifications of FIDAC are as follows: A 35-mm still-frame film 
transport is used which can take up to 250 frames. The film frames can be r, 

advanced automatically under computer control. The logical circuitry uti- 
Tizes integrated circuits soldered to printed circuit cards that are plugged 
into racks for ease of maintenance. The system is of our own design, com¬ 
pletely synchronous, and can be clocked at any frequency up to 10 megahertz. ' 

The circuitry is geared to an easily adjustable master clock. Thus the clock 
speed can be increased or decreased, depending upon the characteristics of 
the computer to be used. The circuitry matching FIDAC to the computer con¬ 
sists of several replaceable cards. These FIDAC-computer interfacing cards 
are the only circuitry that would have to be changed in shifting from one 
computer system to another. The spot size is 1.5 mils at one foot-Lambert 
light output (measured on the face of the CRT). At the 1.5 mil spot size 
and at 2,000 spots per x-sweep of the raster, there is no overlap of spots 
because the x-scan raster is 3 inches wide. The rise time of the photo¬ 
multiplier is 2.3 nanoseconds, the video-amplifier bandpass is 10 MHz (mega¬ 
cycles), and the phosphor persistence is 100 nanoseconds. Thus one sample 
spot per microsecond clearly presents non-overlapping spots. . Dynamic focusing 
is incorporated in FIDAC. This presents an almost constant spot size from 
the center to the sides of the CRT. The sampling rate used is 1 microsecond 
per spot. This means that the four-bit 16^grey-level analog-to-digital con¬ 
version takes place completely within this time period. One frame is scanned 
In about 0.35 seconds for complete picture mode (700 x 500 raste'r), and . 
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^S^'three second's "for a 2 >000 x 1,365 raster. Jitter is’related to the synchro- 

: nization of the triggering of each successive line of the raster. The jitter , 

:j*" : j^'jof the FIDAC is jess than 1 spot. Antipincushioning coils are included in .jv r5P ^ 
{fj .j, v ,both the x and y directions. By aspect ratio is meant the ratio of.the dis- ^ 

Tr. ,, ; tance between adjacent spots in the horizontal and vertical directions. It ^ ;:£ 

js usually desired to keep this at'unity in order that no vertical or hori- rf ^ 

' ' v -zontal distortion occurs. On FIDAC the aspect-ratio is retained when the .'jj 
raster size is changed. The FIDAC can be used with 2 through 16 grey levels 
>for each spot. jEach grey level can be set within 0.12. Shading refers to the 
^correction of the grey-level variation across the area of the picture that 
arises from the CRT, phqtomultipljer,'.and optical systems, y'^orvthe FIDAC, 

"~' v "-the shading generator can 6 Be ^adjusted so that for a- bl ank frame an almost . 

uniform response is obtained across the whole frame. 1 If successive scans 
i- are made on the same picture frame, then the starting point, or very first 
; spot, on such successive frames will be at the .same place in the picture 
• frame to within one spot diameter. The.raster size can vary from line to 
' line in length of line or in the rate of scanning within the line. The 
j. stabil ity of such possible errors js 'within ori‘e_spot diameter. The cutoff; 

"voltage of each leveWetectbr is stable "within .012/ The drift in the out¬ 
put of,the video amplifier has been stabilized to maintain a constant output 
for a given input signal. ""A feedback loop adjusts the average Integrated 
CRT-spot intensity of the frame txra constant value. .j j ; j 

VIDIAC (Vidicon Input to Automatic Computer). The VIDIAC device 
designed and constructed by our electronic laboratory either for 
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(b) 

also 


^canning through a microscope or for scanning large pictures or X rays. It j 
’consists of a high resolution vidicon system that scans at standard TV rates 
,(i.e.,l/30 sec/frame), coupled to a Silicon Video Memory System. The stan- ; 
dard vidicon scan rate is too fast for most analog-to-digital conversion 
r ;.r systems and for data transmission to a digital computer. Hence the Silicon 
'.•>>» Video Memory System acts as an interface between the vidicon and the computer, 
v?#The capabilities of the VIDIAC are as follows. The image scanned by the 

j. vidicon can be displayed on a TV monitor for viewing and for optimizing such 
"^'^^parameters as focus, intensity, contrast, etc. The image scanned by the :r<:4W 
'\idicon can be written onto the Silicon Video Memory System. The electronic j; 

image as stored in this silicon memory can in turn be internally scanned and j 
-'“displayed on either the TV monitor or on the storage tube of the MACDAC. A 
zoom control on the silicon memory and a bias control on the console of the .-j 
\MACDAC can be used to display any portion of the electronic image or to read 
' ’ into the computer any portion of the image. This zoom feature is also under 

computer control. The standard vidicon scan rate of 1/30 sec. per frame is '7 
equivalent to about a 30 megahertz spot sampling rate; this fast scan is the 
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rate from the vidicon to the silicon memory tube and from the silicon memory 
to the TV monitor. The equivalent spot sampling rate from the silicon memory 
to the computer or to the MACDAC, or of writing onto the silicon memory from 
the computer, called the slow scan , is a maximum of a megahertz, but fre¬ 
quently 1/3 megahertz is used. Switching the flow of information between the 
vidicon, TV monitor, MACDAC, and computer, together with the appropriate scan 
rates, is under both manual and computer control. (See Fig. 5.) 

• (c) SPIDAC (Specimen Input to Digital Automatic Computer). The SPIDAC 
is an instrument for scanning directly through a microscope, digitizing the 
resulting grey-level pattern, and placing the digitized image directly into 
the computer's memory. The system is able to automatically manipulate the ; 
microscope slide in both the x and y directions, record the coordinates of 
objects of interest, automatically focus the image instantaneously, and 
monitor results, all under computer control. Eliminating the photographic 
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number of ........ „ 

instances it. is possible that such direct digitization may bring more sen-, XX 
sitivity to grey-level discrimination and can eliminate certain possible . XX 
• grey-level distortions which can occur when using film as'an intermediate 
step. (See Fig. 6.) •*.»»&..' -v- .t -y«- • ^ 

-One of the main functions of the SPIDAC is to locate specimens of in¬ 
terest on the; L glass slide by automatic means, provided that an object of - .... 
interest can .be specified utilizing pictorial parameters. The SPIDAC system 
.performs its operation in two phases. During the first phase a coarse scan ' 
■ (40x objective) is made to determine where the objects of interest are lo- f 
cated. .During .the pecopd pfi^tse ( a final land more accurate determination (at X 
XlOOx objective)’-is made of Whether or not the object located in the first "XX 
' stage is of sufficient interest to be automatically analyzed, and if so then 
Its image is scanned by the VIDIAC and digitized and read into the computer. 
...The pattern-recognition programs in the computer are utilized to compute the 
desired quantitative information from the pictorial data. The 40x and lOOx 
... objectives are parfocal, and a filter is introduced when the lOOx is in place 

“‘^"t'T'^so that no adjustment of thfr'V-idicorr'i'S'’ Necessary when' going from 40x to lOOx 
^t^l^^a'objective.^ii-^.ir:-:-: .rrX: * v; 7 f;./X . ■ 

, . - . v. , it * . ■_ J' <■ . . , . ' <• . ' •- ; ... 
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In particular, SPIDAC scans a 1 cm x 1 cm field on the glass slide. 

-X At 40x objective, the frame size is 200p x 260g, giving about 40 strips‘of 
50 frames each (or 2,000 frames) over the 1 cm 2 area field. Each of the x 
. and y stepping motors is run at a rate of 650 steps/second, with 200 steps/ 

:• revolution, moving the stage 500y/revolution. This amounts to 2.50y/step, 

• t ; '“meaning that we can locate any point in the field to the nearest 1.25y. The 
rate of movement is (650 x 500) * 200 = 1 ,625u/second, or 10,000 * 1,625 or 
about 6 seconds/strip, or finally 6 x 40 = 240 seconds for the 40 strips of 
the field. To move from strip to strip will take a total of 6 seconds across 
the field, so’ the total Scan time limitation due to the motors themselves is 
“;246 seconds or 4 minutes and 6 seconds. In addition, each field is examined 
(in the first phase as described above) for a chromosome spread, and this 
.-.-takes (1/30) second per frame, or 2,000 x (1/30) = 66.6 seconds or 1 minute 
X, and 6.6 seconds. Thus the total time that SPIDAC takes to search a 1 cm x 
1 cm field area for chromosome spreads is 5 minutes and 12.6 seconds. 

XX-X (d) .MACDAC (HAn Communication with Digital Automatic Computer). The 
X MACDAC is an interactive-graphics device designed and constructed by us for 
-^communicating with the computer. Automatic chromosome analysis involves a 
, ; limited but essential manual "editing" step which is accomplished by means 
of the MACDAC. After the computer console 'is properly set up, the control 
of the complete chromosome analysis is carried out by the operator at the 
MACDAC console. The expanded MACDAC will include a hard-copy grey level 
, picture printer. Two monitors are available to the MACDAC. The first is 
.• a Tektronix storage tube capable of only black and white (actually .green) 
display; the second is a TV monitor capabie of grey level display. The 
interaction is carried out by means of a joy stick controlled cursor. For 
any position of the cursor, its 10-bit x and 10-bit y coordinates can be read 
into the computer, together with a four-bit code set by the operator, on a 
priority interrupt basis. This four-bit code identifies for the computer 
the meaning of the x and y coordinates. The interrupt capability allows the 
relatively slow interactive editing process to be carried out at the same 
time as the computer is executing an analysis program, on an overlapping 
basis. (See Fig. 7.) . • - „ 
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re, Fig. 6. - Block Diagram of SPIDA’C system (including the 
t of MACDAC and COMPUTER hardware and software). 
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. '(a) MACDAC Console:' At left is the display tube; at right, the 

the^DDe^riahf 7h? 1 ? W ® P 1 ^ t l/ (main) J^stick controls the cursor 
: *'J® u PP e ^. ri 9 ht (bias) joystick controls the zoom feature. The 

t bias j°y stick controls the four- 

.y clVu 0 ?VV hlcb ls raa ^ ln Wlth the coordinates when the "Read 
: pot b Ii t J? n 1! Pushed. Other, nonstandard codes can be set bv 
.means of the five switches below the main joystick. y 
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(b) Some Details of the MACDAC Design. 
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The MACDAC has two joy sticks, one for normal interaction, and the second 
for zoom control. The zoom control enables any area of the display to be en- 
Gorged so that detail 'can be more easily observed. The MACDAC console in¬ 
cludes switches to control the scan of the FIDAC or VIDIAC, to tell the com- 
puter that the interactive procedure has been completed, to direct the computer 
to display a picture on the monitors, to tell the computer to enable the use 
of the joy sticks, and sa forth.—Either the. analog video signal or the dig¬ 
itized signal can be ; displayed on the MA CDAC. For the digital signal, any 
particular grey level can be seen, or any grey level above a certain cutoff 
level can be displayed, and so forth. . : V 

■ '>?(ej DRIDAC (DRum Input to Digital Aut^om^tic Computer). Many pictures , : 
of biomedical importance are produced in relatively large sizes, both as ' - 
transparencies and black and white prints. 1 Some examples are large chest 
X-ray plates, X rays of large bones. X-ray crystallographic plates, angio¬ 
grams, graphs such as electroencephalographs and electrocardiographs, and 
many others. .The DRIDAC ^device was designed and built at the National Bio¬ 
medical Research Foundation to allow such pictures to be directly read in to 
-a digital computer. K See Fig. 8.) f > i .». 

DRIDAC is a high-speed, high-resolution, on-line drum scanner which can 
scan photographs (X ray, transparency, or print) of any size up to sixteen 
inches by twelve inches of usefuT~area. The resolution may be varied to as’ 
fine as 0.004inches. This allows it to sample 4,000 x 3,000 spots, for a • 
total of 12 million spots, from a large picture. Each spot can be digitized 
as required into one bit (black and white) or up to six bits (sixty-four grey 
■•levels per spot). An automatic background detection and compensation feature 
when activated affords a much greater dynamic range and in effect increases 
the number of grey levels. Another innovation in our drum scanner is the 
utilization of two read stations (see figures) thereby reducing the total 
scan time to one-half the time required by a single read station. 

' In consideration of the large quantity of data which can be obtained 
from a single picture, we have designed the DRIDAG device to-read the pic¬ 
torial data into the core memory of our IBM 360/44 computer at a maximum 
rate of 252,000 bits per second and simultaneously transfer the accumulating 
data from the core into the IBM 2311 disk drive pack (see Fig. 9). Since a 
2311 disk pack will store approximately 54 million bits, this requires a 
slight reduction in grey-scale resolution if we are to read in a full 4,000 
3,000 spot picture. 


*1# 


m 


■m 

’-L + 

.T r 

‘•Nr 

/M 
' M 


m 






$5 


l'VZj&M 
> ■■■ 'P#* 


m 


1 .:.- •*? 


:"•>! t. 5r-’ ; : ‘ ■ 1 




■ ‘"The DRIDAC's drum speed is 420 rpm and its sampling rate is approximately 
35 microseconds per spot. Thus to read in an entire picture requires approx¬ 
imately five minutes. The DRIDAC's high speed in getting a large quantity of 
data onto the disk saves valuable computer time. Once the data is on the disk, 
the program can select any desired portion of the picture at disk speed. It 
would be inappropriate to process data directly from the drum scanner, since 
backtracking or moving to distant spots under the control of the computer is 
slow and would therefore waste computer time. 

t ’ ■ 

Of no less importance than the hardware (or computer instrumentation) is 
the associated software (or computer programming) systems that we have de¬ 
veloped and are available for use in this work. Since the programming sys¬ 
tems or languages are extremely extensive and complex, we can only give the 
"flavor" of the languages in the following discussions. These software 
systems include: .. . ••• 

The specialized pattern-recognition software of the laboratory includes: • 
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Fig. 9. Illustration of System for Interleaving the Two Halves of the 
Picture onto the Disc. 
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-(a) FIDACSYS (FIDAC system). This system inputs the images into the 
computer from the scanning devices, and accomplishes overall picture man- 
ipulation and enhancement. The list of options and subroutines is, too 
lengthy to give here, but we will illustrate a typical set of options 
available for reading from FIDAC or VIDIAC into the computer. 

i-' ^ - -' v f&yt >«- > • *7"' : • • - /. v ' ; ’ •.%. - 

’ . ■ • r ‘• •• fTj ~" _,r 1 1 J _•#—— vv• •- .... 

One part of the system is a general utility program for handling FIDAC 
pictures conveniently. It may be used to read FIDAC, VIDIAC, or DRIDAC, 
store pictures on tape and read pictures from tape, and allows several options 
such as specification of bits per spot from 1 to 6, and limited printing 
windows designated by using the joy stick. Up to fifty character sets are 
stored on disk "FIDACD" and any one maybe called upon to print a picture. 

These character sets may be altered and the complete set may be listed for 
examination at any time. The program can be interactive with the computer 
console and MACDAC, and in this mode responds to one "command" at a time, 
and upon completion types the word "COMMAND?" In general, each command 
consists of two letters and .two numbers. / 

A typical command is CB,change bits: this allows change of spatial 
density.read from FIDAC and number of bits per spot. Spatial density may 
be any integer from‘1 through T5.'“Bits'per'spot may be 1, 2, 3, 4, or 6. 

With this information, the computer determines whether an entire picture ' 
of this size will fit in memory. If it will not fit, the computer responds 
by requesting a window size to be pointed out on the MACDAC scoDe using the 
joy stick. This, window is designated by indicating the width desired, and 
the computer responds by indicating the height allowed for that width by 
drawing the picture limits on the scope. This procedure may be repeated 
until the operator is satisfied with the area he will get. When satisfied, 
he pushes the END button, and the window is stored in memory. Often a pic¬ 
ture size of exact dimensions is necessary, when reading a picture from 
tape, which could not be easily obtained by pointing on the scope. This 
may be specified as follows: when the computer has requested the joy stick 
coordinates for the top. cprners desired, push the INTERRUPT button. .The 
"computer will now"ask for the exact number of spots per row. The number of 
lines is calculated and is not under the operator's control. The END button 
must be pushed to accept the results of this command, unless a non-zero 
number -is typed after spots per row is typed. .:. v 

■■/> v i 'y' ;! • 'V ' | " ' 

Other commands are: CCnn, change characters; CS, change size; CW, 

:change window; PC, print characters; WF, write on film in FIDAC (i.e., 
make a grey level negative on the FIDAC used as a "reverse" scanner); 

RFnn, read FIDAC; RTnnKK, read tape; SP, spectrum point; PPnnKK, print 
picture on high speed printer with a designated character set; WSnn, write 
on the MACDAC display unit; WTnnKK, write tape, and so forth. 

For reading very large pictures' (i.e., raster sizes of 2,000 x 2,000 
spots) a special subprogram is required as follows. The subprogram "FIDPIC" £* 
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reads a FIDAC picture into memory from the FIDAC, but retains only a speci¬ 
fied window in memory. To do this, the program constantly monitors the ad¬ 
dress into which the picture is being read; when an undesired portion is 
being read, this addhess is altered to reference a; "discard" area and that 
portion of picture is thus destroyed. Using this technique, the picture can 
be read, portion after portion, on successive scans, each scanned region 
stored on disc and thereby assembled: as a complete picture which would have 
been too large to be stored in memory in its entirety. ....... . - 

Programs "FIDIND" and "REDUCE" are used in conjunction to read a 4 bit/ 
spot picture from disc and convert to 2 bits/spot in memory with the resultant 
loss in grey levels, but gain in picture size capable of being stored. 
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(b) SYNTAXSYS and BUGSYS Pattern Recognition Languages. These two 
• 4 .'Ste'»s present a large variety of basic pattern-recognition capabilities, 
^'eluding syntax-directed pattern recognition, feature-recognition methods, : 
-rur.'dary-characterization'techniques ,• etc: "We have published extensively 
the. literature oh these languages. ■ ---- - vvt ; ' - vM 

■**' erva i i qo i:cr VOf- reSQfrlH'-* TTTl" r i i-f^A , nr. v JI *»/VL y 

The SYNTAXSYS language uses 'an approach to pattern recognition based ; 
C n some of R.,S. r Ledley's early original research into'picture grammars. 
Consider ^'.characterization of the boundary of an object in terms of five 
types of curves:. a clockwise curve, type A; a relatively straight line, : ^*v 
type' B; a'cpunterclockwise curve, type C; a notch, type D; and a wide clock- 
wisje., £urye, |'type E, p ::Syntactical definitions,of^the’different kinds of , ' 

''chromosomes.'can be made in such’terms as these^ A boundary is first char- 
acterized as a'list of such curve types, and then the syntactical definitions 
are' used to "build up" derived parts of a chromosome from combinations of ' 
'these curve types.;- For example, the syntax for a submedium chromosome and 
a telocentric chromosome is shown in Table 1. The recursive definition 

iS V : . ,,<arm>j: * B<arm> | <arm> ,B.|. A .. 

means th4t"the‘generic concept 'arm is defined as being a B type followed by 
an arm,.or.an arm followed by a B type or an A type. In this notation, the 
angular, brackets < > indicate that_a generic name is enclosed, the =" 
means "is defined as being," and'the "}" means "or." The definition is re-" 
.cursive in that it is used repeatedly. For example,'consider our definitions 
applied to the figure ABC as follows: v.^f.uv •• ’ . 
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where we first (I) identify the A type as an arm, and then build up the arm 
by repeated application of the definition to include (II) the B type on the 
Jeft and (III) the B type on the right. Further consideration of these con- , 
cepts can'be"found in the references. (See Fig. 10.) 

: The process is, of course, systematic, and is carried out by a special 
; program in the SYNTAXSYS system called the M03ILIZER [which is directly 
analogous to the : "trans 1 ator" of autpmatic-programming-language transl,ation]. 
The mobilizer operates on a parts list for a particular object, and by using 
the “generic" syntactTcaldeScripti on "of various 'kinds of chromosomes "rec¬ 
ognizes" the object as a chromosome or not a chromosome, and if a chromo¬ 
some is recognized, as a particular kind of chromosome. Actually the 
mobilizer works with numbers: as shown in Table 1 the syntax can as well 
be written in terms of level numbers, where the numbers are.assigned to the 
left-hand entities in'the order in-which they appear in the syntax. The 
basic parts, namely A, B, C, P, and E, are always considered to have number 
values less than any generic or "derived" part. 
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• s v e . • Table 1. Sample syntax for submedian and telocentric chromosomes. 
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(arm) :: = fl (arm) | (arm) B|»4 
(side) : ; = B (side) | (side) BifljD 


•t ■ 

v jf-'v.. 




'(bottom) : : = B (bottom)J (bottom) fl|E 

. <$?,'>=4 c <”"> ' '■ ■■'SvK? 

: <"i>=;=<“« c y.'- 1 '-;:'£■ 


< submedian \ , . _ /arm \ /armN. 
chromosome/ * * — \pair /\pair/ 

< telocentric \ ../arm\ 
chromosome/ " ’ ^ ^\pair/ 


70 :; = B,70|70,B|/4 r 

71 :: = B.71|71.b;b|D . 

" 72 : : = fl,72|72,B[E 

73:: = C.70 

74 :: = 70.C 

75 :: = 71.75(75.71 
• ; ; * / I70.73J74.70 

76 :: = 75.75 ~ - 

77 : : = 72.75 




The BUGSYS language is a picture-processing and -measuring programming 
language for the analysis of the picture in the computer's memory. The main 
concept of the system is the use of a collection of programmable pointers, 
which are visualized as a family of "bugs." A bug can be "initiated," or — 
"placed," and once initiated a bug can be "moved." In addition, a bug can 
“change" the grey-level value of the spot on which it is located, and it can 
lay down a so-called "stick" across a thick line in the picture as an aid to 
locating the middle of the line. Also, two bugs together can "probe" along 
the direction of the line between them or along a direction perpendicular to 
the line between them. These probes can sense an extension of an object or 
the width of an object, and so forth. "Globs" of objects can be assessed by 
laying down squares and determining the percentage of the area of the square 
intersected with the object. The system is composed of many such statements 
as will be illustrated below. (See Fig. 11.) . • 

1 ,^.^T •‘LS KWVfVl-*- \ -r,< « S ---'*?• i- - * e - - . - • 

> For each bug initiated by means of the macro PLAGE, there is associated 
a list which gives the x and y coordinates of the current position of that 
bug, the actual core location, the spot position within this location, and 
.the grey-level value of the .current position^of the bug. For example, if 
the bug named "ZIPPY"'is in the position ~x - *16, y = 6, then the list for 
ZIPPY might contain the following.-. v/. . 
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Address 

Contents 


' ' ■ Comment 

zippy(I) 

16 

jr 

‘■ ; V .. . ’ . 

zippy(2) 

8 

/ 


zippy(3) 

6351 

6000 

(first location of picture) 


• r-*V- 

+ 350 

{50 words per line x (v— 1)] —• 



+ 1 

(x‘divided by 10 spots per word and 

• - 

"::f' ' 


truncated to an integer) 

■ Z1PPY(4) 

, 6 


remainder of x divided by 10 

Zippy(5) 

4 


gray-level value or contents of spot 


As a bug is moved about the picture by a program, the list of the bug is 
kept current. In fact, in essence, this list is the bug. 

We will now proceed to describe some of the statements of the BUGSYS 
language. The PLACE statement initiates, or sets up, a bug by assighing a 
name and initial coordinates to it. Thus we have 
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11. Illustration of the Application of BUGSYS to Determining Successive 
y Coordinates of a Curve (taken from a Schlieren photograph). The 
dots illustrate the path of the bugs taken in making the successive 
- *. Ay measurements. 
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<PLACE statement? I’. s PLACE <bug name?, <x coordinate?, <y coordinate? 

.here the bug name is a FORTRAN jabel and the - x and y coordinates are either 
^signed integers or integer variables. • _ .. /• 

The BUGS statement‘'allocates'five storage locations to each bug named; 
its form is 




:' -t* 

wH)’,' 


r ...... ' {>e»v. 

‘ w • ?** * Jr: . 


' i; <BUGS statement? p = BUGS (<bug-name list?) . • 

where the bug-name list is a string of bug names separated by commas. 

A bug can be moved a specified distance (i.e., number of spots in the 
picture) in either the x or y direction by the following statement. 

<M0VE statement? :: = HOVE <bug name?,"<directi on?, <distance? 






c 


where the direction is given bythe literals LEFT, RIGHT, UP, or DOWN, and 
the distance is an unsigned integer or integer variable. The statement 
"HOVE ZIPPY, RIGHT, 15" moves the bug named ZIPPY to a new location having 
the same y coordinate but a new xrxoordinate 15 spots to the right of the 
present x coordinate. Each time a bug is.moved, of course, the list 
corresponding to the bug name is adjusted for the new values. 

> Many of the statements involve multiple-way branches, for provision 
must be made to be sure that the bug will not be moved out of the picture. 

For instance, in the MOVE statement if the bug would be moved out of the 
picture, then it is not moved at all, and the next sequential instruction 
is taken as a next executed instruction. Otherwise (i.e., if the bug will 
still be in the picture after the move) the bug is moved and the next 
sequential instruction is skipped. The BUGSYS language also includes pro¬ 
visions for bounding an object.. This is the same subprogram as the bounding 
routine which appears in the SYNTAXSYS system, except that in BUGSYS it can 
‘be utilized in a macro called BOUND. , >*- 

‘(c) MACDACSYS (MACDAC system). This programming system implements the 
“interactive capabilities of the'MACDAC unit, including interrupt features 
for accepting information from, and displaying pictorial and alphanumeric 
information on, the MACDAC unit. Typical examples of operator interactive 
capabilities provided by the MACDACSYS system are as follows. Utilizing the 
joy stick in either regular or zoom mode, the operator can connect two points 
erase an object, slice an object into two parts, and draw a "fence" or line 
around a collection of objects that are to be erased from the picture in the 
computer's memory. Also, the "end of job,",the "end of codes," and an "erase 
last code put in" commands are available. In many interactive-operator pro¬ 
cedures, the objects displayed on the MACDAC display are numbered. The op¬ 
erator can point to one of the numbers to direct the computer to process in 
some way the associated object. To do this the joy stick is positioned with 
the cursor near the number and the "read spot" button is pressed. If the 
computer's bell rings (the IBM 360/44 has a programmable bell) then this 
tells the operator that the cursor is not close enough to the number. This 
method of having the computer signal the operator by means of the bell, or 
a series of coded bell rings, is used extensively in our interactive system. 
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The MACDACSYS system is designed for capability of running in a time 
sharing or overlapping mode. In this mode, the picture being worked on has 
been placed on the MACDAC display directly from the scanners, and not from 
the computer. Thus the computer can be carrying out an entirely different 
^computation with no picture at all, or a different picture, in its memory. 
.Thd-editift^'dY' 1 interactive procedures carried out by the operator are stored 
in the computer's memory, the MAfDACSYS interrupting ijhe computer's compu¬ 
tations from time to time as the operator is working. ' Then, at a later 
'.time when the operator actually scans the picture into the computer's memory, 
the directions given previously by the operator for editing the picture are 
now carried out. ---v; 






(d) r 'SPlDACSYS , {§PiDAC systim)?' This system automatically directs the 
motion of the SPIDAC microscope stage, detects good chromosome spreads, and 
records the coordinates (to the nearest 1.25u) of the center of each such 
.good chromosome spread. It also relocates the microscope stage at such 
coordinates, and directs the vidicon scan into the computer. 

The SPIDACSYS software package consists of two parts. The first part is 
'pertinent to'~the covering, detection, and locating centers of the objects of 
interest_(e.g., chromosome spreads) during the search mode. The second part 
controls the stepping motors and moves the microscope stage such that these 
objects are centered automatically for detailed analysis during the analysis 
mode. ' ;:r*. • •**; . 

The complete operational procedure is as follows: The operator or the 
technician first puts the glass slide onto the microscope stage, selects the . 
origin (usually left-upper corner of the cover slip), and turns to the low 
power object lens. At the same time, he loads the softv/are package into the 
computer. When everything is ready, he pushes the start button and waits. 
Meanwhile, the hardware searches the successive fields of a strip, and then 
goes to the next strip, etc. until the forty strips have been searched field 
by field. In between searches the software program finds covers and de¬ 
termines centers of the objects of interest (e.g., chromosome spreads) in 
'’each field, and this information is saved for the analysis mode. An optional 
Visual display is also included in the software program. This visual display 
puts all the coverings and domains of chromosome spreads on the MACDAC scope 
(or TV screen) for each field. (See Fig. 12.) • ; ;1. ... 

?>' c r pflext the operator or computer switches the objective lens from low power 
to high power. He then pushes the start button for the analysis mode. The 
’computer program sends"a ’signal' to the "hardware'to move the .microscope stage 
so that each of the objects found is successively centered under the objective 
lens. The hardware sends the detailed scan of each such object one by one 
onto a TV screen. The technician judges from the TV screen the acceptability 
of the object for analysis. If it is a bad one, he may reject it and the next 
Object will be shown. If it is a good one, he may push the analysis button. 
This enables the fine scan of the object to be made and the object is ana¬ 
lyzed by the computer. Then the next available object will be displayed. 

This procedure continues until all the objects have been processed. The 
softv/are program then moves the microscope stage back to its. original 
position and terminates the procedure. 

(e) DOCS (Display Of Chromosome Statistics). The DOCS programming 
system enables on-line computer-console interaction with the disk memories 
of the computer for the evaluation and display of large masses of data in 
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, Fig. 12. Application of SPIDAC to Detecting Chromosome Spreads. 

(a) Chromosome spread as seen on MAC DA C display tube. 

(b) Horizontal lines illustrate the recognition of the portion 
X*../"Of a :chromosome spread. • nc r:~;. ' ■ 

(c) Two chromosome spreads in a field. 

(d) Result of computer locating each of the chromosome spreads. 
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a file. For instance, analyses of variance, t-tests, and other statistical 
tests cah be executed on data selected from the file. The DOCS system guides 
the user in a step-by-step dialogue, so that all of the detailed specifica¬ 
tions required for the desired statistical analysis or data display can be 
obtained. , 4 •. .>...... ‘ / ' '■■■' 

. (f)._REM0TE. ..This programming system enables the remote user to be' 
'serviced by the computer. 
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